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Project  Suanexy: 

This  project  employed  psychophysical  techniques  to  examine  the  limitations 
on  spatial  vision  imposed  by  the  first  stages  in  the  visual  pathway.  All  the 
experiments  capitalized  on  the  use  of  laser  interferometry,  which  allows 
sinusoidal  gratings  to  be  formed  on  an  observer's  retina  that  are  immune  to  opti¬ 
cal  blurring.  Comparisons  of  contrast  sensitivity  to  such  gratings  with  con¬ 
trast  sensitivity  to  gratings  viewed  under  normal  conditions  provides  an  esti¬ 
mate  of  the  modulation  transfer  function  of  the  eye's  optics.  In  addition,  the 
appearance  of  very  high  frequency  gratings  is  distorted,  or  aliased,  by  the  cone 
mosaic.  Such  moire  patterns  provide  the  basis  for  a  number  of  psychophysical 
techniques  to  assess  the  topography  of  the  cone  mosaic  in  the  living  eye.  These 
measurements,  accompanied  by  measurements  of  visual  acuity  for  interferfence 
fringes  clarify  the  relationship  between  cone  spacing  and  resolution.  Resolu¬ 
tion  was  also  measured  under  conditions  in  which  only  the  M  or  L  cones  could 
detect  the  interference  fringe.  Visual  acuity  was  little  different  than  it  was 
when  both  cone  types  detected  the  grating,  showing  that  resolution  is  immune  to 
photoreceptor  loss  under  these  circumstances. 


lUiMarch  Ob jaetlvaa : 

The  objectives  of  the  original  proposal  were  two-fold:  1)  to  provide 
Improved  measurements  of  the  optical  quality  of  the  eye,  and  2)  to  estimate  the 
packing  geometry  of  the  M  and  L  cone  submosaics  in  the  living  human  fovea. 


Status  of  the  Research: 

Six  lines  of  investigation  are  outlined  below  that  have  been  pursued  during 
the  AFOSR  grant.  They  are  described  in  turn  below: 


1 .  Optical  Quality  of  the  Huatan  lye. 

Measurements  of  foveal  contrast  sensitivity  for  interference  fringes 
obtained  in  my  laboratory  with  an  lnproved  laser  interferometer  (Williams, 

1985b)  were  strikingly  different  from  those  reported  by  Campbell  and  Green 
(1965)  :  the  more  recent  measurements  averaged  nearly  an  order  of  magnitude  more 
sensitive  at  high  spatial  frequencies  (60  cycle/deg)  .  This  finding  warranted  a 
reevaluation  of  Canpbell  and  Green' s  estimates  of  the  modulation  transfer  func¬ 
tion  of  the  eye,  which  were  based  on  their  interferometric  contrast  sensitivity 
measurements.  Measurements  were  made  of  the  modulation  transfer  function  of 
three  human  eyes  for  2  and  3  mm  pupils,  by  dividing  the  contrast  sensitivity  func¬ 
tion  obtained  in  normal  viewing  by  that  obtained  with  interference  fringes,  as 
Campbell  and  Green  had  done.  These  new  modulation  transfer  functions  were  simi¬ 
lar  to  those  reported  by  Campbell  and  Green  (only  slightly  steeper) ,  despite  the 
large  difference  in  interferometric  contrast  sensitivity.  The  implication  is 
that  both  the  coherent  and  incoherent  contrast  sensitivity  functions  obtained  by 
Campbell  and  Green  (for  two  subjects)  revealed  substantially  reduced  sensitivity 
at  high  frequencies  conpared  with  the  3  observers  in  the  present  study,  so  that 
the  estimate  of  the  MTF  was  little  different.  The  explanation  for  the 
discrepancy  in  contrast  sensitivity  is  partly  procedural,  but  largely  due  to 
real  individual  differences.  This  was  confirmed  by  measuring  contrast  sensi¬ 
tivity  on  one  of  Canpbell  and  Green's  original  observers  (Dan  Green)  on  the 
improved  Interferometer  at  Rochester. 


2 .  Color  J^pearanee  of  High  Frequency  Interference  Frlngea . 

Experiments  performed  in  collaboration  with  Mary  Hayhoe  (Hayhoe  and  Willi¬ 
ams,  1987)  have  shown  that  fine  monochromatic  gratings  appear  markedly  desa- 
turated  compared  with  a  uniform  field  of  the  same  wavelength.  Observers  matched 
the  color  of  a  foveal  uniform  field  to  that  of  a  monochromatic  grating  alternated 
with  it.  Gratings  were  unity  contrast  interference  fringes  with  wavelengths 
spanning  the  spectrum.  The  matching  field  was  a  mixture  of  a  white  of  adjustable 
intensity  and  an  incoherent  monochromatic  light  of  adjustable  Intensity  and 
wavelength.  Fine  gratings  appear  desaturated  at  all  wavelengths,  corresponding 
to  an  excitation  purity  of  about  0.6  in  the  largest  case.  The  desaturation  was 
also  seen  with  brief  flashes  of  the  grating  and  matching  fields  (50  msec) ,  show¬ 
ing  that  it  is  not  a  temporal  effect  produced  by  eye  movements. 

Of  particular  interest  is  the  observation  that  long  wavelength  gratings  that 
stimulate  only  M  and  L  cones  also  appear  desaturated;  they  can  only  be  matched  by 
stimuli  that  also  stimulate  S  cones.  This  excludes  explanations  that  invoke 
intensive  nonlinearities  that  differ  across  cone  types  because  they  would 
predict  a  shift  in  the  color  appearance  of  long  wavelength  gratings  (that  do  not 
directly  stimulate  S  cones)  only  along  the  spectrum  locus  in  CIE  space. 
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We  proposed  a  second  kind  of  explanation,  in  which  saturation  is  determined 
by  the  ratio  of  signals  in  achromatic  and  chromatic  channels,  which  in  turn 
depends  on  spatial  frequency.  If  the  achromatic  channel  is  spatially  bandpass 
and  the  chromatic  channel  is  low  pass,  the  desaturation  should  increase  with 
increasing  spatially  frequency  and  then  decrease  at  still  higher  frequencies. 
Indeed,  measurements  show  that  the  effect  grows  steadily  with  increasing  spatial 
frequency,  peaking  at  about  20  cpd,  and  falling  off  gradually  at  higher  frequen¬ 
cies.  In  the  context  of  this  model,  we  estimated  the  spatial  frequency  response 
of  the  underlying  chromatic  and  achromatic  mechanisms.  The  estimates  imply 
receptive  fields  that  have  centers  fed  by  only  one  or  two  cones,  with  surrounds 
5-6  times  larger. 


3 .  Topography  of  the  Poweal  Cone  Mosaic  in  the  Living  Buaan  Kye . 

Interference  fringes  whose  spatial  frequency  exceeds  the  resolution  limit 
form  visible  moire  patterns  or  '^ebra  stripes"with  the  foveal  cone  mosaic  (Byram, 
1944;  Cangtbell  and  Green,  1965;  Williams,  1985a;  Williams,  1988)  .  These  moire 
patterns  contain  rich  information  about  the  topography  of  foveal  cones  in  the 
living  human  eye.  To  confirm  that  the  observed  patterns  are  indeeo  generated  by 
cone  aliasing,  I  developed  a  model  of  foveal  cone  sampling  that  shows  how  the 
moire  patterns  should  depend  on  the  spatial  frequency  and  orientation  of  an 
interference  fringe  imaged  on  a  triangular  lattice  of  cones.  The  predictions  of 
the  model  were  then  tested  and  found  to  be  consistent  with  the  results  of  two 
psychophysical  experiments. 

The  Moire  Sexo  Technique:  The  model  predicts  that  the  moire  pattern  should  be 
coarsest  when  the  period  of  the  interference  fringe  equals  the  spacing  between 
cones .  The  intuition  behind  this  prediction  is  easily  grasped  by  considering  the 
simplified  case  of  a  static,  one-dimensional  array  of  regular  sampling  elements. 
If  the  spacing  between  sanpling  elements  is  equal  to  the  spacing  between  stripes 
of  the  grating  superimposed  on  them,  then  all  the  elements  will  catch  the  same 
number  of  quanta.  The  grating  will  then  produce  the  same  response  in  the  array  as 
a  uniform  field  would  have  produced.  This  match  between  grating  and  sampling 
array  will  be  referred  to  as  a  'taoire  zero".  This  prediction  was  tested  by  asking 
observers  to  adjust  the  spatial  frequency  of  the  interference  fringe  to  make  the 
zebra  stripes  as  coarse  as  possible  at  various  retinal  eccentricities  within  the 
fovea.  These  settings  were  quantitatively  consistent  with  anatomical  estimates 
of  cone  spacing  across  the  human  fovea  (Osterberg,  1935;  Miller,  1979;  Curcio,  et 
al,  1987)  .  This  'taoire  zero"  technique,  validated  in  this  way,  provides  a  psycho¬ 
physical  method  for  measuring  cone  spacing  within  1.75  deg  of  the  fovea. 

A  second  prediction  of  the  model  is  that,  due  to  the  60  deg  rotational  sym¬ 
metry  characteristic  of  the  packing  of  primate  foveal  cones  (Hirsch  and  Hylton, 
1984) ,  the  moire  patterns  should  change  from  coarse  to  fine  with  every  60  deg  of 
rotation  of  the  interference  fringe  (Williams,  1988,  copy  in  Appendix)  .  A 
psychophysical  experiment  in  which  the  overall  spatial  frequency  of  the  moire 
pattern  was  judged  as  a  function  fringe  orientation  confirmed  this  prediction, 
allowing  the  orientation  of  the  cone  mosaic  to  be  determined  at  the  foveal 
center. 


4.  Additional  Psychophysical  Measures  of  Cone  Spacing. 

The  moire  zero  technique  for  estimating  cone  spacing  is  particularly  well 
suited  to  sampling  arrays  that  are  highly  regular,  such  as  the  cone  mosaic  at  the 
foveal  center.  However,  the  cone  mosaic  becomes  rapidly  less  regular  just  out¬ 
side  the  fovea,  and  two  additional  techniques  were  developed  to  estimate  average 


3 


cone  spacing  there.  These  techniques,  developed  In  collaboration  with  Nancy 
Coletta,  have  an  advantage  over  the  moire  zero  technique  In  that  they  can  be 
Implemented  with  a  forced  choice  psychophysical  procedure.  They  are  described  in 
turn  below. 

Orientation  Itaversal  Technique.  Coletta  and  williams  (1987a)  observed 
that,  in  parafoveal  retina,  interference  fringes  with  spatial  frequencies  above 
the  resolution  limit  can  look  like  two  dimensional  spatial  noise  with  strlations 
running  perpendicular  to  the  true  orientation  of  the  fringe.  This  appearance  Is 
consistent  with  the  sampling  properties  of  the  disordered  extrafoveal  cone 
mosaic.  A  model  constructed  from  the  Fourier  spectra  of  primate  extrafoveal 
mosaics  predicts  that  this  orientation  reversal  should  occur  when  the  period  of 
the  Interference  fringe  equals  the  average  spacing  between  cones.  Psychophysical 
experiment  confirms  this  prediction,  providing  a  measure  of  cone  spacing  In  the 
parafovea. 

Motion  Reversal  Technique.  Another  phenomenon  provides  a  second  measure  of 
average  cone  spacing  In  extrafoveal  retina.  Aperiodic  moving  stimulus  can 
appear  to  move  in  the  reverse  direction  If  It  Is  undersampled  In  time,  as  In  the 
case  of  the  'Vagon  wheel"  effect  caused  by  an  Inadequate  frame  rate  In  motion  pic¬ 
tures.  Coletta  and  Williams  (1987b)  reported  the  spatial  analog  of  this  effect 
for  gratings  that  are  undersampled  by  the  cone  mosaic:  high  spatial  frequency 
Interference  fringes,  viewed  In  the  parafovea,  appear  to  move  In  the  opposite 
direction  from  their  true  direction  of  motion.  Observers  named  the  direction  of 
motion  of  vertical,  unity  contrast  fringes  whose  direction  was  randomly  deter¬ 
mined  on  each  trial.  Percent  correct  fell  significantly  below  chance  perfor¬ 
mance  at  high  spatial  frequencies.  Indicating  a  reversal  In  the  perceived  direc¬ 
tion  of  motion. 

Insects  exposed  to  drifting  high  frequency  gratings  show  a  reversed  optomo- 
tor  response  (von  Gavel,  1939;  Hassensteln,  1951;  (3oetz,  1964)  because  they 
respond  to  the  moire  pattern  produced  by  their  photoreceptor  mosaic,  which  moves 
oppositely  to  the  original  grating.  If  the  motion  reversal  we  have  observed  has 
the  same  basis,  the  spatial  frequency  at  which  the  perceived  direction  of  motion 
reverses  should  correspond  to  Integral  multiples  of  the  cone  Nyquist  frequency. 
Measurements  of  this  frequency  at  various  eccentricities  agree  with  anatomical 
and  psychophysical  estimates  of  the  cone  Nyquist  frequency. 


5 .  Supra-Nyqulet  Visual  Rmsolutlon 

The  moire  zero,  orientation  reversal,  and  motion  reversal  techniques  all 
provide  estimates  of  cone  spacing  that  agree  with  each  other  and  with  the  esti¬ 
mates  from  retinal  anatomy  In  monkey  and  man  cited  earlier.  This  allows  cone 
spacing  and  visual  acuity  to  be  conpared  in  the  same  retinal  locations  of  the  same 
observers.  It  Is  commonly  assumed  that  the  visual  resolution  limit  must  t>e  equal 
to  or  less  than  the  Nyquist  frequency  of  the  cone  mosaic.  However,  under  some 
conditions,  observers  can  see  fine  patterns  at  the  correct  orientation  when 
viewing  Interference  fringes  with  spatial  frequencies  that  are  as  much  as  1.5 
times  higher  than  the  nominal  Nyquist  frequency  of  the  underlying  cone  mosaic . 
This  was  confirmed  with  a  forced  choice  orientation  discrimination  task  (Willi¬ 
ams  and  Coletta,  1987b)  . 

The  existence  of  supra-Nyqulst  resolution  demands  closer  scrutiny  of  the 
sanpllng  effects  of  the  cone  mosaic  and  the  Information  that  Is  sufficient  for  an 
observer  to  "resolve"  a  sinusoidal  grating.  First,  sampling  by  the  cone  mosaic 
does  not  remove  Information  about  high  spatial  frequencies  In  the  way  that  spa¬ 
tial  filtering  does.  Sampling  Introduces  ambiguity  In  the  form  of  aliasing:  the 
observed  distribution  of  quantum  catches  In  the  mosaic  Is  consistent  with  many 
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retinal  images  rather  than  just  one.  The  Nyquist  frequency  specifies  which 
images  can  be  reconstructed  without  interference  from  aliasing.  However,  it  is 
not  a  theoretical  upper  bound  for  psychophysical  measures  of  visual  resolution 
because  the  criteria  for  resolving  sinusoidal  gratings  (such  as  orientation 
identification)  are  less  stringent  than  the  criteria  specified  by  the  sanpling 
theorem  for  perfect,  alias-free  image  reconstruction.  This  result  is  important 
for  any  atteiqpt  to  relate  visual  resolution  to  the  anatomical  density  of  neural 
arrays  in  the  visual  system. 


6 .  Visual  Resolution  and  Aliasing  with  M  and  Xi  Cone  "Isolation" 

One  goal  of  the  AFOSR  grant  was  to  explore  aliasing  effects  in  the  separate  M 
and  L  cone  mosaics,  with  the  hope  of  uncovering  their  packing  arrangements  in  the 
fovea.  Our  strategy  has  been  to  first  develop  and  refine  of  techniques  applica¬ 
ble  to  the  M  and  L  cones  working  together,  as  described  above,  so  that  these  tech¬ 
niques  could  be  applied  with  more  finesse  to  the  problem  of  the  packing  arrange¬ 
ment  of  the  submosaics.  The  progress  made  so  far  on  the  sutxnosalc  problem  is 
described  below. 

The  first  question  we  have  addressed  is  whether  the  appearance  of  foveal 
zebra  stripes  is  affected  when  only  a  single  cone  submosaic  (either  M  or  L)  can 
detect  the  interference  fringe.  Given  that  the  zebra  stripes  provide  a  measure 
of  cone  spacing  and  that  the  total  number  of  cones  is  reduced  in  effect  by  isolat¬ 
ing  a  single  submosaic,  it  might  at  first  seem  that  the  spatial  frequency  produc¬ 
ing  a  moire  zero  would  shift  be  lower  under  isolation  conditions.  A  second  ques¬ 
tion  we  have  addressed  is  whether  foveal  resolution  is  reduced  when  either  the  M 
or  I,  submosaic  alone  contributes  to  the  task  compared  with  conditions  when  both  M 
and  L  cones  contribute  together.  One  view  would  hold  that  it  would  be:  if  foveal 
resolution  is  limited  by  cone  sampling,  then  visual  acuity  for  a  grating  that 
stimulates  only  a  single  cone  type  should  be  reduced  as  a  result  of  the  reduction 
in  spatial  sanpllng  rate.  For  example,  assume  for  simplicity  that  the  loss  of  one 
cone  type  through  chromatic  adaptation  reduces  the  number  of  effective  sanpling 
elements  underlying  the  fringe  by  a  factor  of  two.  (The  actual  value  will  be 
somewhat  more  or  less  depending  on  the  ratio  of  M  to  L  cones)  .  If  the  remaining 
cones  were  arranged  in  a  perfectly  regular  lattice,  the  Nyqpilst  frequency  of  the 
submosaic  would  be  1/V2  or  71%  of  its  value  when  M  and  L  cones  operate  together. 
This  simplistic  application  of  sampling  theory  would  then  predict  that  visual 
resolution  would  be  reduced  correspondingly.  As  described  below,  our  data  so  far 
are  quite  inconsistent  with  both  these  predictions  about  aliasing  and  resolu¬ 
tion,  which  we  will  argue  are  conceptually  misguided  to  begin  with. 

Chromatic  adaptation  was  used  to  attempt  to  isolate  M  or  L  cones  in  the  manner 
of  Green  (1968)  .  Measureioents  were  made  for  three  kinds  of  interference  fringe 
stimuli:  1)  those  of  equal  contrast  for  M  and  L  cones  produced  by  superimposing 
either  a  488  nm  or  a  633  nm  fringe  on  a  background  of  the  same  wavelength,  2) 
fringes  that  favored  M  cone  grating  detection  in  which  a  unity  contrast  488  nm 
grating  was  superimposed  on  a  660  nm  uniform  adapting  field,  and  3)  fringes  that 
favored  L  cone  grating  detection  in  which  a  unity  contrast  633  nm  grating  was 
superimposed  on  a  460  nm  background.  The  observer  made  two  settings  for  each  of 
these  conditions  of  chromatic  adaptation;  1)  he  adjusted  the  spatial  frequency 
of  the  fringe  to  his  resolution  limit  defined  as  the  highest  spatial  frequency  at 
which  he  could  perceive  fine  stripes  at  the  appropriate  orientation,  and  2)  He 
adjusted  the  spatial  frequency  of  the  interference  fringe  to  produce  the  coar¬ 
sest  zebra  stripes  at  the  foveal  center  (moire  zero) . 

The  swan  settings  for  both  these  tasks  are  plotted  in  Fig.  1.  The  abscissa  is 
an  index  of  the  cone  isolation  achieved  by  the  three  adaptation  conditions,  where 
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0  indicates  perfect  M  cone  isolation,  1  indicates  perfect  L  cone  isolation,  and 
0. 5  indicates  equal  contrasts  in  both  M  and  L  cones.  The  contrasts  in  the  M  and  L 
cones  for  each  of  these  stimuli  were  calculated  using  Smith  and  Pokorny  fundamen¬ 
tals  (Boynton,  1979).  The  most  extreme  adaptation  conditions  used  produced 
roughly  30%  contrast  in  the  favored  cone  type,  and  about  3%  in  the  unfavored  cone 
type.  These  conditions  were  chosen,  based  on  the  results  of  contrast  sensitivity 
measurements,  so  that  both  fringes  near  the  resolution  limit  and  zebra  stripes 
would  be  above  contrast  threshold  for  the  favored  cone  mechanism,  but  well  below 
threshold  for  the  unfavored  cone  mechanism.  The  results  show  that  neither  reso¬ 
lution  nor  the  moire  zero  depend  on  the  ratio  of  contrasts  in  the  two  cone  types, 
even  when  the  ratio  approaches  a  factor  of  10.  Furthermore,  the  observer  could 
detect  no  obvious  subjective  difference  between  the  zebra  stripes  seen  when  both 
cone  types  operating  together  and  when  one  or  the  other  cone  type  was  strongly 
favored. 
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Why  shouldn't  foveal  resolution  decrease  when  only  one  submosaic  is  operat¬ 
ing?  The  logic  that  leads  to  the  prediction  of  a  resolution  loss  under  chromatic 
adaptation  rests  on  the  assumption  that  the  remaining  submosaic  is  perfectly 
regular.  This  is  unlikely  to  be  true,  and  we  have  previously  shown  that,  under 
some  conditions,  observers  can  reliably  identify  the  orientation  of  a  grating 
even  when  its  spatial  frequency  exceeds  the  Nyquist  limit,  calculated  in  this 
way,  by  50%.  That  is,  the  Invariance  of  visual  resolution  with  chromatic  adapta¬ 
tion  is  consistent  with  supra-Nyqulst  resolution  observed  in  the  parafovea  (Wil¬ 
liams  andColetta,  1987)  .  Despite  the  removal  of  sanpllng  elements  by  chromatic 
adaptation,  there  are  apparently  sufficient  samples  remaining  to  provide  the 
observer  with  enough  information  to  recognize  a  grating  as  a  grating. 
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Unfortunately#  thia  conclualon  rests  on  the  assumption  that  the  chromatic  adap¬ 
tation  technique  succeeded  in  isolating"  a  single  cone  mechanism,  which  is  not  is 
not  immune  to  criticism. 

Why  doesn't  the  moire  zero  change  when  only  one  submosaic  is  operating?  The 
moire  zero  should  not  change  because  the  removal  of  sampling  elements  from  a 
mosaic,  in  either  a  random  or  regular  fashion,  does  not  eliminate  the  periodicity 
in  the  mosaic  that  is  responsible  for  the  moire  zero.  This  fact  can  be  understood 
by  considering  Fig.  2.  Panel  A,  on  the  left,  shows  shows  a  regular  triangular 
lattice  sampling  a  grating  whose  period  nearly  equals  the  sample  spacing.  The 
low  frequency  diagonal  grating  is  the  resulting  moire  or  alias.  On  the  right,  2/3 
of  the  samples  from  the  original  array  have  been  removed  in  random  fashion. 
Clearly,  the  moire  is  unaffected.  The  lower  panel  (B)  shows  that  this  is  true 
even  if  the  removal  of  cones  in  nonrandom.  In  this  case,  on  the  right,  only  every 
third  row  of  receptors  have  been  retained,  yet  the  moire  is  the  same.  So  there  is 
in  fact  no  theoretical  expectation  that  the  spatial  frequency  yielding  the  coar¬ 
sest  zebra  stripes  should  change  when  one  submosaic  is  effectively  removed. 

This  does  not  imply  that  there  are  no  differences  in  the  aliasing  effects 
predicted  for  a  complete  mosaic  and  the  submosaics  that  comprise  them.  For  exam¬ 
ple,  the  submosaic  on  the  lower  right  has  a  Nyquist  frequency  for  horizontal 
gratings  that  is  only  a  third  that  of  the  complete  mosaic.  This  implies  that 
there  will  be  a  second  moire  zero  for  the  submosaic  at  a  third  the  frequency  of  the 
moire  zero  shared  by  both  mosaics.  That  is,  regular  submosaics  should  show  addi¬ 
tional  moire  effects  at  low  frequencies  over  and  above  those  seen  with  the  com¬ 
plete  sampling  array.  Completely  random  submosaics,  on  the  other  hand,  would 
produce  2-dimensional  aliasing  noise  at  all  spatial  frequencies  that  would  not 
be  present  with  the  conplete  mosaic  (Ahumada,  1986) . 
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